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Abstract. The past decade has seen a flurry of research into pattern avoid- 
ing permutations but little of it is concerned with their exhaustive generation. 
Many applications call for exhaustive generation of permutations subject to 
various constraints or imposing a particular generating order. In this paper we 
present generating algorithms and combinatorial Gray codes for several fami- 
lies of pattern avoiding permutations. Among the families under consideration 
are those counted by Catalan, large Schroder, Pell, even-index Fibonacci num- 
bers and the central binomial coefficients. We thus provide Gray codes for the 
set of all permutations of {1, . . . , n} avoiding the pattern r for all r E ©3 and 
the Gray codes we obtain have distances 4 or 5. 

1. Introduction 

A number of authors have been interested in Gray codes and generating algo- 
rithms for permutations and their restrictions (unrestricted 10J , with given ups and 
downs [14[ 118]. involutions, and fixed-point free involutions [24] . derangements [3], 
permutations with a fixed number of cycles [2]) or their generalizations (multiset 
permutations [131 H3|)- A recent paper [T2] presented Gray codes and generating 
algorithms for the three classes of pattern avoiding permutations: 6„ (123, 132), 
6„(123, 132, p{j) — 1) . . . l(p + 1)), and permutations in S n (123, 132) which have 
exactly (») — & inversions. In [6] a general technique is presented for the gener- 
ation of Gray codes for a large class of combinatorial families; it is based on the 
ECO method and produces objects by their encoding given by the generating tree 
(in some cases the obtained encodings can be translated into the objects). Moti- 
vated by these papers, we investigate the related problem for several new classes of 
pattern avoiding permutations. 

More specifically, we give combinatorial Gray codes for classes of pattern avoiding 
permutations which are counted by Catalan, Schroder, Pell, even-index Fibonacci 
numbers and the central binomial coefficients; the Gray codes we obtain have dis- 
tances 4 or 5. Our work is different from similar work for combinatorial classes 
having the same counting sequence, see for instance [6] [22] . Indeed, as Savage [211 
§7] points out: ' Since bijections are known between most members of the Catalan 
family, a Gray code for one member of the family gives implicitly a listing scheme 
for every other member of the family. However, the resulting list may not look like 
Gray codes, since bijections need not preserve minimal changes between elements.^ 

Some direct constructions for ©„(231) exist but are, however, not Gray codes. 
For example, Bona [H §8.1.2] provides an algorithm for generating 6„(231). This 
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algorithm is such that the successor of the permutation ir = (n, n — 1, . . . 2, 1, 2n + 
1, 2n, 2n- 1, . . . , n + 2, n + 1) is %' = (1, 2, . . . , n - 1, 2n + 1, n, n + 1, . . . , 2n). The 
number of places in which these two permutations differ is linear in n. 

In Section 2 we present a combinatorial Gray code for 6„(231) with distance 4. 
In Section 3 we present a Gray code for the Schroder permutations, 6 n (1243, 2143), 
with distance 5. In Section 4 we present a general generating algorithm and Gray 
codes for some classes of pattern avoiding permutations and discuss its limits. 

The techniques we will use are: in Section 2 and 3 reversing sublists [20] ; in 
Section 3 combinatorial bijections [T^]; and in Section 4 generating trees [pj. 

Throughout this paper, it is convenient to use the following notation. The num- 
ber c„ = ( 2 ^) is the n-th Catalan number. The large Schroder numbers r„ are 
defined by — 1 and for all n > 0, 

a 

(1-1) r n = r w _i + yVfe-iTn-fc. 

k=l 

Let A(l) = 0, 5(1) = and for all i > 1, 

(1.2) A(i) = c + ... + Ci_2, and 

(1.3) = r + ... + n- 2 . 

The parity of these numbers will be extremely important in proving the Gray 
code properties of the generating algorithms for permutations we define later on 
in the paper. However, the parity of A(i) and B(i) are not explicitly used in the 
algorithms. Note that for all < k < 2", A(2 n + k) is odd iff n is even. One 
can easily show that B(i) is odd iff i = 2. For two permutations a = o\Oi . . . a n 
and r = tit 2 . . . r„ in 6„, the metric d(<r, r) is the number of places in which they 
differ; and we denote by a or (or more compactly as err) their product, that is, the 
permutation 7r in 6 n with 7^ = r CTi for all i, 1 < i < n. In particular, when a is 
the transposition (it,i>), then (u,v) o r is the permutation 7r with 7r^ = Tj for all i, 
except that 7r u = and tt v = t u . 

2. A Gray code for 6„(231) 

Note that if (ir(l), . . . , 7r(c n )) is an ordered list of elements of S„(231) such 
that d(ir(i), Tr(i + 1)) < 4, then the operations of reverse, complement and their 
composition provide lists for S„(132), 6„(213) and S„(312), respectively, which 
preserve the distance between two adjacent permutations. 

2.1. Generating 231-avoiding permutations. First we introduce some general 
notation concerning the list T> n that our algorithm will generate and then provide 
the necessary proofs to show that V n is the desired object. 

For every n > 0, let T> n denote a list consisting of c„ entries, each of which is 
some permutation of {1, ... ,n}. The j-th entry is denoted £>„ (j). In order that 
we may copy such a list, either in its natural or reversed order, we define T> % n to 
be T> n if i is odd, and T> n reversed if i is even, for every positive integer i. Thus 
VUl) = ^n 1 (cn + for all 1 < j < c„. 

By T> n (j)+l we shall mean T> n {j) with every element incremented by the value /. 
Concatenation of lists is defined in the usual way, concatenation of any permutation 
with the null permutation yields the same permutation, i.e. [r, 0] = [0, r] = r. 
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The list V n is defined recursively as follows; Vq consists of a single entry which 
contains the null permutation that we denote as 0. For any n > 1, 

(2-D 2>„ = 000 

i=i j=i k=i 

where A(i) is defined in Equation (|1.2|) and © denotes the concatenation operator, 
e.g. 

2 2 

0©(/(i,j)) = (/(l,l),/(l,2),/(2,l),/(2,2)). 

i=l 3 '=1 

Lemma 2.1. T/ie fot P„ contains all 231-avoiding permutations exactly once. 

Proof. Every permutation 7r 6 6„(231) may be decomposed as ir — rna, where 
r £ 6i_i(231) and a is a 231-avoiding permutation on the set {i, . . . ,n — 1} which 
is order-isomorphic to a a' £ & n -i- In "D n , n assumes the positions i = 1, 2, . . . , n. 
For each position i of n, r runs through alternately forwards and backwards, 
forwards the last time. For each r, a runs through 2?j_i + (t— 1) alternately forwards 
and backwards, backwards the first time (see Table 1). The result follows by strong 
induction on n. □ 

Lemma 2.2. For all n > 2, 

P n (l) = nl23 • • • (n - 1) andV n (c n ) = 123- --n. 

Proof. The proof proceeds by induction on n. We have V = 0. Assume the result 
holds for each i = 0, 1, 2, . . .n — 1. Then by Equation (|2.ip . 2? n (l) corresponds to 
the expression with i = 1, j = 1 and fc = 1 ; 

P„(l) - = nVl_ x (\) = nV n - X {cn-i) = nl23 • • ■ (n - 1). 

The last entry T> n (c n ) corresponds to the expression in Equation (|2.ip with i = 

n,j = Ci_i and fc = 

2?„( C „) = P2n-l (cn i)n = 123 ... n . 

□ 

Theorem 2.3. for eac/i g G {1, 2, . . . c„ — 1}, T> n (q) differs from its successor 
T> n (q + 1) by a rotation of two, three or four elements. 

Proof. The proof proceeds by induction. The result holds trivially for n — 1 since 
T>i consists of a single permutation. Assume the result holds for T>i for each i = 
1, 2, . . .n — 1. From Equation (|2.1|) . there are 3 cases: 

(i) The current permutation corresponds to (i;j; k = t) and the next permuta- 
tion corresponds to (i; j; k = t + 1), where t € {1,2,... c„_j — 1}. Therefore 

V n (q) = I^+r\3)nVi + _t {i)+1 (t) + (i-l) 
V n (q + 1) = V^t'^nK^^it+y + ii-l), 
and by the induction hypothesis, 

d(V n (q),V n (q + 1)) = d{V n ^{t),V n ^{t + 1)) < 4. 
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(ii) The current permutation corresponds to (i,j —t,k = c n ~i) and the next 
permutation corresponds to = t + 1; k = 1), where t € {1, 2, . . . Cj_i — 1}. 
Therefore 

V n (q) = ^(fJnD^^M + ti-l) 
V n (q + 1) = V^it + ^nV^f^M + ii-l). 
Since x^+^w +1 (Cn-i) = 2?n*i 2 (l)i the induction hypothesis gives 
d(© n (g),I> n ( g +l))=d(I> i _i(i),X> < _i(i+l)) <4. 

(iii) The current permutation corresponds to (i = t;j = Cj_i; fc = c„_i) and the 
next permutation corresponds to(i = t+ l;j = l;fc = l), where t £ {1, . . . 
n — 1}. Therefore 

2> n («) = V^-\c t ^)nV c :zl +A(t)+ \c n ^) + {t-l) 

V n { q + l) = r> t " +t (l)n^+fil +1)+1 (l)+t. 

This divides into four cases, where in each case we use Lemma 12.21 and the 
fact that A(t + 1) = A(t) + c t -\. 

(a) If n + 1 is odd and Ct_i + + 1 = A(t + 1) + 1 is odd, then 

V n {q) = 123 ... (t-l)nt(t+l) ... (n-1) 
V n (q + l) = 123 ... (t-l)tn(t+l) ... (n-1). 

Here T> n (q+ 1) is obtained from T> n (q) via a single transposition of elements 
at positions (t, t + 1). 

(b) If n + 1 is odd and ct-i + A(t) + 1 is even, then 

D„(<?) = 12 ... (t-l)n(n-l)t(t+l) ... (rc-2) 
+ = 12 ... (t-l)tn(n-l)(t + l) ... (n-2), 

for all t < n — 3. Here T> n (q + 1) is obtained from T> n (q) via a rotation of 
the 3 elements at positions (t, t + 1, i + 2). If f = n — 2 then 

P n (g) = 12 ... (n-3)n(n-l)(n-2) and 
V n (q + l) = 12 ... (n-3)(n-2)n(n-l). 

These permutations differ by a rotation of the 3 elements at positions (n — 
2, n — 1, n). If £ = n — 1 then 

V n (q) = (n-2) 12 ... (n-3)n(n-l) and 
P n (g + 1) = (n-1) 12 ... (n-3)(n-2)n. 

These permutations differ by a rotation of the 3 elements at positions (1, n— 
l,n). 

(c) If n + t is even and Ct~i + A(t) + 1 is odd, then 

D„(g) = (£ — 1)12 ... (t-2)nt(t+l) ... (n-1) and 

2? w (« + l) = *12 ... (t-2)(t-l)n(t+l) ... (n-1) 

for all t > 3. Here I?„ (g + 1) is obtained from V n (q) via a rotation of the 
3 elements at positions (1, t, t + 1). 

The degenerate cases £ = 1,2 are dealt with in the same manner as those 
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Table 1. The Gray code T> 6 for the set S 6 (231) given by rela- 
tion (|2.ip and produced by Algorithm 1. Permutations are listed 
column-wise and changed entries are in bold. 



612345 


621534 


165243 


312645 


421365 


215436 


621345 


615234 


165432 


312654 


412365 


125436 


613245 


615324 


165423 


321654 


512346 


125346 


632145 


615243 


162543 


321645 


521346 


123546 


631245 


615432 


162534 


132645 


513246 


213546 


621435 


615423 


162354 


132654 


532146 


132546 


612435 


654123 


163254 


213654 


531246 


321546 


614235 


654213 


164235 


213645 


521436 


312546 


614325 


654132 


164325 


123645 


512436 


412356 


643125 


654321 


162435 


123654 


514236 


421356 


643215 


654312 


163245 


123465 


514326 


413256 


641325 


651432 


162345 


213465 


543126 


432156 


642135 


651423 


126345 


132465 


543216 


431256 


641235 


651243 


126435 


321465 


541326 


143256 


631254 


652143 


126354 


312465 


542136 


142356 


632154 


653124 


126543 


214365 


541236 


124356 


613254 


653214 


126534 


124365 


154236 


214356 


621354 


651324 


216534 


142365 


154326 


312456 


612354 


652134 


216543 


143265 


152436 


321456 


612534 


651234 


216354 


431265 


153246 


132456 


612543 


165234 


216435 


432165 


152346 


213456 


621543 


165324 


216345 


413265 


215346 


123456 



at the end of part (b) . 

(d) If n + 1 is even and Ct-i + A(t) + 1 is even, then 

T> n (q) = (t-l)12 ... (t-2)n(n-l)t(t+l) ... (rc-2) 

V n (q+1) = 1 12 . . . (t - 2) (t - l)n(n - 1) (t + 1) . . . (n - 2), 

for all 3 < t < n — 3. Here T> n (q + 1) is obtained from V n (q) via a rotation 
of the 4 elements at positions (l,t,t + l,t + 2). The degenerate cases 
i = 1, 2,n — 2,n — 1 are dealt with in the same manner as those at the end 
of part (b). 

□ 

In Table Q] is given the list T>e obtained by relation (|2.1|) . The alert reader will 
note that there is no rotation of 4 elements in Table 1. Such a rotation is first 
observed when n = 7 and t = 3 (the permutation 2176345 becomes 3127645). 

3. A Gray code for Schroder permutations 

The permutations 6„(1243, 2143) are called Schroder permutations and are just 
one of the classes of permutations enumerated by the Schroder numbers mentioned 
in the Introduction. Let S n be the class of Schroder paths from (0,0) to (2n, 0) 
(such paths may take steps u = (1,1), d = (1,-1) and e = (2,0) but never go 
below the a;-axis) . This class S n is enumerated by r n , see for instance [9] . 

In what follows, we will present a recursive procedure for generating all Schroder 
paths of length n. This procedure has the property that if the paths in S n are 
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Algorithm 1 Pseudocode for generating 6^(231) using Equation (|2.ip . The list 
T> n is computed for each 1 < n < N. Here denotes the reversal of list V n . 
set Do to a 1 x matrix 
set L>i := [1] 
for n :— 2 to N do 

rstate := n (mod 2) {1 means forwards and means backwards} 
estate := 
for i := 1 to n do 
for I := 1 to i — 1 do 
if rstate = then 

r =:£>£.! (I) 
else 

r := A-i (0 
end if 

for r := 1 to c n _j do 
if estate=0 then 

a := (r) + (i - 1) 
else 

a := (r) + (i - 1) 

end if 

new_row:= [r, n, cr] 
Append new_row to D n 
end for 

estate := estate + 1 (mod 2) 
end for 

rstate := rstate + 1 (mod 2) 
end for 
end for 



listed as (pi,p2, ■ • •)> then the sequence of permutations {<p(pi), <p(p2), ■ ■ ■) is a Gray 
code for 6 n +i (1243, 2143) with distance 5. First we briefly describe Egge and 
Mansour's 9, §4] bijection ip : S n ^ S n+ i(1243, 2143). 
Let p £ S n and let S{ be the transposition (i, i + 1). 

Step 1: For all integers a, m with < a, m < n, if either of the points 
((8m+l)/4, (8a+5)/4) or ((8m + 5)/4, (8o+l)/4) is contained in the region 
beneath p and above the x-axis, then place a dot at that point. For such a 
dot, with coordinates (x, y), associate the label Sj where i = (1 + x — y)/2. 
Let j = 1. 

Step 2: Choose the rightmost dot that has no line associated with it (with 
label Sfe, say). Draw a line parallel to the x-axis from this dot to the leftmost 
dot that may be reached without crossing p (which has label s;, say). Let 
Cj = SkSk-i-.-Si, where Sj, applied to a permutation n, exchanges 7r^ 
with 7r i+1 . If all dots have lines running through them, then go to step 3. 
Otherwise increase j by 1 and repeat step 2. 

Step 3: Let ip(p) = <Jj . ■ ■ 02< J \{ n + 1, n, . . . , 1). 

Example 3.1. Consider the path p £ Sq in the diagram. 
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TTie dote indicate the points realized in Step 1 and the lines joining them indicate 
how each of the a's are formed. We have o\ = ses^, gi = S4S3S2S1, 03 = S3S2S1 
and (74 = S2 ■ So 

(pip) = CT 4 f7 3 f720'i(7,6, 5,4, 3,2, 1) 

= s 2 S3S2S1 S4S3S2S1 s 6 s 5 (7, 6, 5,4, 3,2, 1) 
= (5,2,4,6,7,1,3). 

3.1. Generating all Schroder paths. There are many ways to recursively gener- 
ate all Schroder paths of length n. In what follows, we give one such procedure for 
generating the list S n . This list has the property that the corresponding permuta- 
tions, under the bijection ip, are a Gray code for Schroder permutations of distance 
5. 

As in Section 2, we will use the convention that for any integer i, <S^ = S n if i 
is odd and S l n is S n reversed, if i is even. Entry j of S n is denoted S n (j). In this 
notation we will have 

S i , ■ \ _ f <S„(j) if i is odd, 

n ' \ S n (r n + 1 - j) if i is even. 

Define So to be the list consisting of the single null Schroder path, denoted 0. 
For all n > 1, the paths are generated recursively via 

(3.1) S n = (ei S„_ 1 W)©000(u^(j)d^+f W+1 (fc)). 

i=l i=l j=l fc=l 

<S n starts with 5 n _i with each path preceded by e. There follow all the Schroder 
paths beginning with u. Let d be the partner of this u (the d that returns the path 
to the x axis). Then d assumes positions i — 2, 4, 6, . . . , 2n in the path. For each 
i, we have the paths in uad/3, where a runs through Si-i alternately forwards 
and backwards, backwards the last time, and for each a, (3 runs through S n -i 
alternately forwards and backwards, backwards the first time. 
Furthermore, we define &n(j) '■= vC^nO)) an d 

r n 

(3-2) $„ := 0$„(j). 

i=i 

For example, we have Si = (e, ud) and £2 = (ee, eud, udud, ude, uudd, ued). Thus 
$1 = (21, 12) and $ 2 = (321,312, 132,231, 123,213). The paths and permutations 
S3, $3, 5 4 and $4 are listed in Tables 2 and 3. For two paths p\,pi £ S n , we 
write d{j>\,p2) for the number of places in which the two paths differ when each e 
is replaced by rr where r represents (1,0); e.g. d(e, ud) = 2 and e?(ued, eud) = 2. 

Lemma 3.2. Equation h3.1\) generates all Schroder paths of length n. 
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Proof. This is routine by induction. The first concatenation operator forms all 
paths that begin with step e. If a path does not begin with e, then it does not 
touch the x axis for the first time until (2i, 0) . A path of this form is uniquely 
expressed as uad/3 where a £ Si-i and /? G Sn-i- □ 

Lemma 3.3. For all n > 1, 5„(1) = e" and S n (r n ) = ue n ~ 1 d. 

Proof. By Equation (|3 . 1 1) we have that Si(l) = e and Si (2) = ud; so the result is 
true for n = 1. Assume it to be true for all m < n — 1. Then S n (l) — e<S„_i(l) = 
ee"- 1 = e". 

Similarly S n (r n ) corresponds to Equation (|3.1|) with i = n,j — r„_i,fc = ro, 
thus 

S n (r n ) = u^iK-Od = ue^d = ue^d. 
Hence by induction the result is true for all n > 1. □ 

Under the bijection ip, we thus have 

Corollary 3.4. For all n > 0, 

$„(!) - (n + l)n...l, 
®n{r n ) = n ... l(n + l). 

Theorem 3.5. For each 1 < q < r n , S n (q) differs from S n (q + 1) in at most 5 
places and d(^ n {q)i &n(q + 1)) < 5. 

Proof. This proof follows by strong induction and analyzing the different successors 
that occur in Equation (|3.1j) . The statement in the Theorem holds for n — because 
there is only one permutation. We assume the statement in the Theorem holds true 
for all Q < i < n — 1. From Equation (|3.ip there are five cases to consider: 

(i) H 1 < q < r n -i -1, then S n (q) = eS n ^i(q) and S n (q+ 1) = eS n -i(q+l). 
This gives 

d(S n (q),S n (q+l)) = d{S n ^{q\S n - X {q+\)), 
which is < 5 by our hypothesis. Thus 

$„0) = (n + l)$ n _i(q) and 
^n(«+l) = (n+l)$„_i(g+l), 

and so d($ n (q), $„(g + 1)) < 5. 

(ii) If q = r„_i then by Equation (13. ip with (i = l; j= 1; k = 1) and Lemma l3~3l 
we have 

S n (r n ^x) = eS„_i(r„_i) = eue n_2 d and 
«S n (r„_! + l) = udS£_ x (l) = udue"- 2 d. 

Thus d(5 n (r„_i),<S n (r n _i + 1)) = d(eue"- 2 d, udue"- 2 d) = 2. The corre- 
sponding permutations are 

$n{r n -i) = (n + 1) (n - 1) (n - 2) . . . 2 In and 
*„(r n _i + l) = (n-l)(n + l)(n-2) ... 2 In, 

so that d($„(r„_i),$ n (r n _i + 1)) = 2 < 5. 
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(iii) If S n (q) corresponds to = ri-i;k = t) for some 1 < t < r„_i in 
Equation (13. 1|) then 

S n (q) = u5f_+/(r i _ 1 )d5^f« +1 ( i )and 
5 n (g+l) = u^(r,_ 1 )d5^f W+1 (t+l), 

and the distance of the two paths is no greater than 5, by the induction 
hypothesis. Therefore 

$„(q) = ao(n + l,...,n + 2-i 1 tp(S J n tf il)+1 (t))) and 
$„(<? + 1) = ao(n + l,...,n + 2-z,^+f W+1 (< + l))), 
where 

{SiSi-i . . . sx, if n + « even, 

Si_i . . . siSiSi_i ... si, if n + i odd. 

Using the fact that if d(b, b 1 ) < x, then d(a ob,a o b') < x, we have by the 
induction hypothesis d(& n (q), & n {q + 1)) < 5. 

(iv) If S n (q) corresponds to Equation (|3. 1|) with triple (i; j = t;k = r„_i), where 
1 < t < ri-x, then the successor S n (q + 1) corresponds to Equation ()3.1|) 
with triple (i; j = t + 1; fc = 1). Consequently, 

5 n (g) = u^(t)dS£? W+1 (r«-i) and 
S„(? + l) = u^(t+l)dS£? W+2 (l). 

Since <S*^jf ^ +1 (r„_i) = «S*^jf 2 (1), the result for <S n follows by the in- 
duction hypothesis applied to 5™^'. Now if t + + 2 is odd, then 

$„(<?) = 0(u S£%(t) d) i (i - 1) . . . 1 and 
+ 1) = sp(u 5^ji*(t + 1) d) * (i - 1) ... 1, 

where <^(u c5^Lj(f) d) is <p(u S"^(t) d) with every element incremented by 
i. Since d(S^(t), S£%(t + 1)) < 5, we have that d($ n (q), <f> n (q + 1)) < 5. 
The case where t + B(i) + 2 is even is handled in a similar manner with the 
suffix i(i — 1) . . . 1 replaced by (i — 1) . . . 1(2 + 1). 

(v) If S n (q) corresponds to Equation (|3.ip with triple (•£ = t;j = fj_i;fe = 
r n _j), where 1 < i < n, then iS ra (g + 1) corresponds to Equation (|3.1[) with 
triple (i = t + 1; j = 1; k = 1). Consequently 

S n (q) = u S^-i* (r t _0 d S^ 1 +B(t)+1 (r„_ t ) and 

5„(g+l) = uSr' +1 (l)dS£f^ 1)+1 (l). 

This divides into 4 sub-cases depending on the parity of the numbers n + t 
and r t _i + S(t) + 1 = B(t + 1) + 1. Each case is easily resolved by applying 
Lemma 13.31 

(a) If n + t is even and B(t + 1) + 1 is even, then 

S n (q) = u«S t 2 _ 1 (r t _i)d«S2_ 4 (r„_ t ) = ue^de"-* and 
S n (q + 1) = u<S i (l)d«S n _ t _ 1 (l) = ue'de""'- 1 , 
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which differ in two positions. This gives 

®n(q) = n(n - 1) . . . (n - t + 1) (n+ 1) (n - t) (n - t - 1) . . . 1 and 

*„(g + l) = n(n-l) ... (n-t)(n+l)(n-t-l) ... 1, 

for all 1 < t < n — 1. The two permutations differ by a transposing 
the elements at positions (t + l,i + 2). 

(b) If n + t is odd and B(t + 1) + 1 is odd, then 

5„(g) = u5t_i(r t _i) d 5„_ t (r n _t) = uue t_2 ddue n_ * _1 d and 

S n (q + l) = u5 t 2 (l)d^_ t _ 1 (l) = uue^ddue""*-^, 

which differ in five positions. This gives 

®n(q) = (n-l)---(n-t + 2)(n-t)n(n+l)(n-t-l)---l(n-t+l)and 

*n(g + l) = (n-l)---(n-t + l)(n-t-l)n(n+l)(n-t-2)---l(n-t), 

for all 2 < £ < n — 2. These two permutations differ in five places (a 
transposition of the positions (t — 1 , n) and a cycle of three elements 
at positions (t, t + 1, t + 2)). For i = 1 we have 

$ n (q) = n(n+l)(n-l)(n-2) ... 1 and 

$„(<? + 1) = (n-l)n(n+l)(n-2) ... 1, 

which differ by a cycle of three elements at positions (1,2,3). Similarly, 
for t = n — 1 we have 

®n{o) = (n-1) ... l(n+l)n and 
$„(g + l) = (n-1) ... ln(n+l), 

which differ by transposing the entries in positions (n, n + 1). 

(c) If n + t is odd and £?(t + 1) + 1 is even, then 

S n (q) = u5 t _i(ri_i)d5^_ t (r n _i) = uue^dde™"* and 

5„(g + l) = u5 2 (l)d5„_ t _ 1 (l) - uue^dde""*- 1 . 

Thus S n (q + 1) differs from S n (q) in four positions. This gives 

$„(g) = (n - 1) . . . (n - t + l)n(n+ 1) (n - t) . . . 1 and 

$„(<?+ 1) = (n-1) ... (n-t)n(n+l)(n-t-l) ... 1, 

for alH > 2. The two permutations differ in three places (a rotation of 
three elements at positions (t, t + 1, t + 2)). The degenerate case t = 1 
is handled in the same manner as in part (a). 

(d) If n + t is even and B(t + 1) + 1 is odd, then 

S n (q) = u ^(rt-i) dS n - t {r n -t) = ue^due""*-^ and 
5„(g+l) = u5 t (l)d5 2 _ t _ 1 (l) = ue'due"-'-^. 

Thus S n (q + 1) differs from S n (q) in five positions. This gives 
® n (q) = n(n-l)---(n-t + 2)(n-t)(n+ l)(n - t - 1) • • • l(n - t + 1) 
and 

$„(g+ 1) = n(n - 1) • •• (n - i + l)(n - t - l)(n+ l)(n - t - 2) ■ • ■ l(n - t), 

for alH < n — 2. The two permutations differ in four places (the two 
disjoint transpositions of elements at positions (t, n + 1) and (t+l,t + 
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Table 2. The lists S 3 and $ 3 . 



n 


S 3 (n) 


$3(n) 


n 


S 3 (n) 


$ 3 (n) 


n 


5 8 (n) 


$ 3 (n) 


1 


eee 


4321 


9 


udude 


2431 


17 


uuedd 


2134 


2 


eeud 


4312 


10 


ududud 


1432 


18 


uuuddd 


1234 


3 


eudud 


4132 


11 


udeud 


3412 


19 


uuded 


2314 


4 


eude 


4231 


12 


udee 


3421 


20 


uududd 


1324 


5 


euudd 


4123 


13 


udee 


3241 


21 


ueudd 


3124 


6 


eued 


4213 


14 


uedud 


3142 


22 


ueed 


3214 


7 


udued 


2413 


15 


uuddud 


1342 








8 


uduudd 


1423 


16 


uudde 


2341 









2)). The degenerate case t = n — 1 is handled in the same manner as 
in part (a). 

□ 

The lists 1S3, $3, 1S4 and $4 are given in Table [2] and O Note that, unlike the 
list S n is a circular Gray code; its first and last element have distance at most five. 
The choice of a Gray code for Schroder paths is critical in our construction of a 
Gray code for 6„(1243, 2143) since Egge and Mansour's bijection tp, generally, does 
not preserves distances. For instance d(e n , ue n— 1 d) = 2 but <p(e n ) — (n + l)n ... 1 
differs from (/?(ue n_1 d) = n . . . l(n + 1) in all positions. Also, there already exists a 
distance five Gray code for Schroder paths [22] but it is not transformed into a Gray 
code for 6„(1243, 2143) by a known bijection. Finally, as in the previous section, 
both Gray codes presented above can be implemented in exhaustive generating 
algorithms. 

4. Regular patterns and Gray codes 

Here we present a general generating algorithm and Gray codes for permutations 
avoiding a set of patterns T, provided T satisfies certain constraints. The operations 
of reverse, complement and their composition extend these to codes for T c , T r and 
T rc . Our approach is based on generating trees; see [H El [25] and the references 
therein. In [6] a general Gray code for a very large family of combinatorial objects 
is given; objects are encoded by their corresponding path in the generating tree 
and often it is possible to translate the obtained codes into codes for objects. The 
method we present here is, in a way, complementary to that of [6]: it works for a 
large family of patterns and objects are produced in 'natural' representation. It is 
also easily implemented by efficient generating algorithms. Its disadvantage is, for 
example, that it gives a distance-5 Gray code for 6(231), and so is less optimal 
than the one given in Section 2; and it does not work for T = {1243, 2143} (the set 
of patterns considered in Section 3) since T does not satisfy the required criteria. 

We begin by explaining the generating trees technique in the context of pattern 
avoidance. The sites of tt £ 6 n are the positions between two consecutive entries, 
as well as before the first and after the last entry; and they are numbered, from 
right to left, from 1 to n + 1. For a permutation ir G 6„(T), with T a set of 
forbidden patterns, i is an active site if the permutation obtained from 7r by inserting 
n + 1 into its i-th site is a permutation in S n +i(T); we call such a permutation in 
6„ + i(T) a son of tt. Clearly, if n e 6„ + i(T), by erasing n + 1 in n one obtains 
a permutation in 6 n (T); or equivalently, any permutation in 6 n +i(T) is obtained 
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Table 3. The lists S 4 and $ 4 . 



n 


S 4 (n) 


$ 4 (n) 


n 


<S 4 (n) 


$ 4 (n) 


n 


<S 4 (n) 


$ 4 (n) 


1 


eeee 


54321 


31 


uduedud 


35142 


61 


uududde 


24351 


2 


eeeud 


54312 


32 


ududee 


35241 


62 


uududdud 


14352 


3 


eeudud 


54132 


33 


ududee 


35421 


63 


uudedud 


34152 


4 


eeude 


54231 


34 


ududeud 


35412 


64 


uudede 


34251 


5 


eeuudd 


54123 


35 


udududud 


15432 


65 


uuuddde 


23451 


6 


eeued 


54213 


36 


ududude 


25431 


66 


uuudddud 


13452 


7 


eudued 


52413 


37 


ududuudd 


15423 


67 


uueddud 


31452 


8 


euduudd 


51423 


38 


ududued 


25413 


68 


uuedde 


32451 


9 


eudude 


52431 


39 


udeued 


45213 


69 


uueedd 


32145 


10 


eududud 


51432 


40 


udeuudd 


45123 


70 


uueuddd 


31245 


11 


eudeud 


53412 


41 


udeude 


45231 


71 


uuududdd 


13245 


12 


eudee 


53421 


42 


udeudud 


45132 


72 


uuudedd 


23145 


13 


eudee 


53241 


43 


udeeud 


45312 


73 


uuuudddd 


12345 


14 


euedud 


53142 


44 


udeee 


45321 


74 


uuueddd 


21345 


15 


euuddud 


51342 


45 


uuddee 


34521 


75 


uuudded 


23415 


16 


euudde 


52341 


46 


uuddeud 


34512 


76 


uuuddudd 


13425 


17 


euuedd 


52134 


47 


uuddudud 


14532 


77 


uuedudd 


31425 


18 


euuuddd 


51234 


48 


uuddude 


24531 


78 


uudeed 


32415 


19 


euuded 


52314 


49 


uudduudd 


14523 


79 


uudeed 


34215 


20 


euududd 


51324 


50 


uuddued 


24513 


80 


uudeudd 


34125 


21 


eueudd 


53124 


51 


Lied Lied 


42513 


81 


uudududd 


14325 


22 


eueed 


53214 


52 


ueduudd 


41523 


82 


uududed 


24315 


23 


udueed 


35214 


53 


uedude 


42531 


83 


uuduuddd 


14235 


24 


udueudd 


35124 


54 


uedudud 


41532 


84 


uuduedd 


24135 


25 


uduududd 


15324 


55 


uedeud 


43512 


85 


ueuedd 


42135 


26 


uduuded 


25314 


56 


uedee 


43521 


86 


ueuuddd 


41235 


27 


uduuuddd 


15234 


57 


ueede 


43251 


87 


ueuded 


42315 


28 


uduuedd 


25134 


58 


ueedud 


43152 


88 


ueududd 


41325 


29 


uduudde 


25341 


59 


ueuddud 


41352 


89 


ueeudd 


43125 


30 


uduuddud 


15342 


60 


ueudde 


42351 


90 


ueeed 


43215 



from a permutation in 6„(T) by inserting n + 1 into one of its active sites. The 
active sites of a permutation tt G 6„(T) are right justified if the sites to the right 
of any active site are also active. We denote by XT(h^) the number of active sites 
of the permutation obtained from tt by inserting n + 1 into its i-th active site. 
A set of patterns T is called regular if for any n > 1 and tt e & n (T) 

• tt has at least two active sites and they are right justified; 

• Xt(*, t) does not depend on tt but only on the number k of active sites of 
tt; in this case we denote Xt(*,ti") by xr(h k). 

In what follows we shall assume that T is a regular set of patterns. Several 
examples of regular patterns T, together with their respective \ functions, are 
given at the end of this section. 

Now we will describe an efficient (constant amortized time) generating algo- 
rithm for permutations avoiding a regular set of patterns; then we show how we 
can modify it to obtain Gray codes. If n = 1, then & n (T) — {(1)}; otherwise 
& n (T) = U 7re e ?i _ 1 (T){c G 6 n a is a son of tt\. An efficient implementation is 
based on the following considerations and its pseudocode is given in Algorithm 2. 
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Figure 1. (a) The generating tree induced by the call of 
Gen_Avoid(l,2) for n = 4 and with x defined by: y(l, k) = k + 1 
and xihk) = i if i ^ 1- It corresponds to the forbidden pattern 
T = {321}. The active sites are represented by a dot. (b) The first 
four levels of the generating tree induced by the definition (|4.2[) 
with the same function x\ they yield the lists Ci(321) for the sets 
6,(321), 1 < i < 4. This tree is the Gray-code ordered version of 
the one in (a). Permutations in bold have direction down and the 
others direction up. 




.1.2.3. 



1 3.2. 



3.1.2. — 



2.1.3. 



2 3.1. 



.1.2.3.4 
1 2 4.3 
1 4.2.3 
4.1.2.3 
1 3.2.4 

1 3 4.2 
3.1.2.4 
3 1 4.2 
3 4.1.2 
2.1.3.4 

2 1 4.3 
2 4.1.3 
2 3.1.4 
2 3 4.1 



.1.2.3. 




.1.2.3.4. 
1 4.2.3. 
4.1.2.3. 
1 2 4.3. 
3 1 4.2. 

3.1.2. — 3 4.1.2. 
3.1.2.4. 
1 3 4.2. 

1 3.2.4. 

2 3.1.4. 
2 3 4.1. 
2 1 4.3. 

2.1.3. — 24.1.3. 

2.1.3.4. 



1 3.2. 



2 3.1. 



(a) 



(b) 



The permutation obtained from n G 6 n _i(T) by inserting n into its first (right- 
most) active site is im. Let a (resp. t) be the permutation obtained from 7r by 
inserting n into the i-th (resp. (i + l)-th) active site of ir. In this case r is obtained 
by transposing the entries in positions n — i + 1 and n — i of a . In addition, if 
XT(j", k) is calculable, from i and k, in constant time, then the obtained algorithm, 
Gen_Avoid (Algorithm 2), runs in constant amortized time. Indeed, this algorithm 
satisfies the following properties: 

• the total amount of computation in each call is proportional with the num- 
ber of direct calls produced by this call, 

• each non-terminal call produces at least two recursive calls (i.e., there is no 
call of degree one), and 

• each terminal call (degree-zero call) produces a new permutation, 

see for instance [19] and Figure Q] (a) for an example. 

Now we show how one can modify the generating procedure Gen_Avoid sketched 
above in order to produce a Gray code listing. We associate to each permutation 
7T G 6„(T) 
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• a direction, up or down, and we denote by tt 1 the permutation tt with direc- 
tion up and by ir° the permutation tt with direction down. A permutation 
together with its direction is called directed permutation. 

• a list of successors, each of them a permutation in S„+i(T). The first 
permutation in the list of successors of tt 1 has direction up and all others 
have direction down. The list of successors of tt° is obtained by reversing 
the list of successors of tt 1 and then reversing the direction of each element 
of the list. 

Let tt £ & n (T) with k successors (or, equivalently, k active sites), and Lk be the 
unimodal sequence of integers 

( f 1,3,5,. ..,k,{k-l),(k-3),... ,4,2 iffcisodd 

[ ' k \ l,3,5,...,(fc- l),fc,(fc-2),...,4,2 if fc is even. 

This list is very important in our construction of a Gray code; it has the following 
critical properties, independent of k: it begins and ends with the same element, 
and the difference between two consecutive elements is less than or equal to 2. 

For a permutation tt with k active sites, the list of successors of tt 1 , denoted by 
(^(tt 1 ), is a list of k directed permutations in 6„+i(T): its j-th element is obtained 
from tt by inserting n + 1 in the Lfe(j)-th active site of tt; and as stated above, the 
first permutation in (^(tt 1 ) has direction up and all others have direction down. And 
we extend <fi in natural way to lists of directed permutations: <P(tt(1), 7r(2), . . .) is 
simply the list 4>(tt(1)), 4>(tt(2)), . . .. This kind of distribution of directions among 
the successors of an object is similar to that of |26j . 

Let d n = card(6„(T)) and define the list 

d n -l 

(4.2) C n (T)=C n = 0<KC„-i(?)) 

9=1 

where C n (q) is the g-th directed permutation of C n , anchored by Ci = (l) 1 . We will 
show that the list of permutations in C n (regardless of their directions) is a Gray 
code with distance 5 for the set 6 n (T). With these considerations in mind we have 

Lemma 4.1. 

• The list C n contains all T '-avoiding permutations exactly once; 

• The first permutation in C n is (1, ... , n) and the last one is (2, 1,3, ... ,n). 

Lemma 4.2. If tt 1 is a directed permutation in C n (that is, tt is a length n permu- 
tation and i G {0, 1} is a direction), then two successive permutations in 4>{tt 1 ), say 
a and t, differ in at most three positions. 

Proof. Since 4>(tt°) is the reverse of ^(Tr 1 ) it is enough to prove the statement for 
i = 1; so suppose that i = 1. Let a and r be the permutations obtained by inserting 
n + 1 in the Lfe(j)-th and Lk(j + l)-th active site of tt, respectively, for some j. 
Since \L k {j) - L k (j + 1)| < 2, d(a, r) < 3. □ 

Let tt 1 £ C n and £(tt 1 ) denote the first (leftmost) element of the list 4>(tt 1 ), ^(tt 1 ) = 
£(£(tt 4 )), and I s (tt 1 ) = l{l s ~ x (tf)) . Similarly, r(TT l ) denotes the last (rightmost) 
element of the list 4>(tt 1 ), and r s (TT l ) is defined analogously. For tt 1 £ C n let dir(7r 4 ) = 
i £ {0, 1}. By the recursive application of the definition of the list 4>(tt z ) we have 
the following lemma. 
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Table 4. The Gray code list C 5 (321) for the set 65 (321) given 
by relation (14. 2p and with succession function \ in Paragraph 14. 11 
Permutations are listed column-wise in 14 groups; each group con- 
tains the sons of a same permutation in 64(321), see Figure [T]b. 
In bold are permutations with direction down and the others with 
direction up. 



12345 


45123 


34152 


13245 


24513 


12534 


41523 


31254 


23145 


24153 


51234 


41235 


35124 


23514 


21354 


15234 


12453 


31524 


23154 


25134 


12354 


12435 


31245 


23451 


21534 


14253 


31425 


13425 


23415 


21345 


14523 


31452 


13452 


21435 




14235 


34125 


13254 


21453 




41253 


34512 


13524 


24135 





Lemma 4.3. // V G C n , then dir^ 8 ^)) = 1 and dir(r s (?r 1 )) = for any s > 1. 

Proof. the first successor of tt % has direction up for any i 6 {0,1}, and 

generally dir(£ s (tt 1 )) = 1 for s > 1. Similarly, r(7r 4 ), the last successor of 7r* has 
direction down for any i G {0, 1}, and dir(r s (7r')) = for s > 1. □ 

Lemma 4.4. If er, t G & n (T) and d(a, r) < p, then, for s > 1, 

d(rV),*V))<P- 

Proof. r(cr ) = (a, (n + 1))° and ^(t 1 ) = (t, (n+ l)) 1 . Induction on s completes the 
proof. □ 

Theorem 4.5. Two consecutive permutations in C n differ in at most five positions. 

Proof. Let a % and be two consecutive elements of C n . If there is a ir m G C n -i 
such that a 1 ,^ G 0(7r m ), then, by Lemma |4.2[ a and r differ in at most three 
positions. Otherwise, let 7r m be the closest common ancestor of a % and r 3 in 
the generating tree, that is, 7r is the longest permutation such that there exists 
a direction m G {0, 1} with a 1 , r 3 G (t>{4>{- ■ ■ 4>{^ m ) ■ ■ ■))• I n this case, there exist 
a a and f3 b successive elements in </>(7r m ) (so that a and (3 differ in at most three 
positions) and an s > 1 such that a % — r s {a a ) and r J = £ s (f3 b ). 

If s = 1, then a and r are obtained from a and (3 by the insertion of their largest 
element in the first or second active site, according to a and b; in these cases a and 
r differ in at most five positions. (Actually, if a = b, then a and r differ as a and 
/3, that is, in at most three positions.) 

If s > 1, by Lemma H31 dir(r(a a )) = ... = dir(r s (a a )) = and dir(£(/3 b )) = 
. . . = dir(£ s ([3 b )) = 1. Since r(a a ) and £{(3 h ) differ in at most five positions, by 
Lemma FOI so are a and r. □ 

The first and last permutations in C n have distance two, so C n is a circular Gray 
code, see Table 4. The generating algorithm Gen_Avoid sketched in the beginning 
of this section and presented in Algorithm 2 can be easily modified to generate the 
list C n (T) for any set of regular patterns: it is enough to change appropriately the 
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Algorithm 2 Pseudocode for generating permutations avoiding a set T of regular 
patterns characterized by the succession function After the initialization of 

7r by the length 1 permutation [1], the call of Gen_Avoid(l, 2) produces & n (T). Its 
ordered version, as described in Section 4, produces distance-5 Gray codes, 
procedure Gen_Avoid(size, k) 
if size = n then 

Print(7r) 
else 

size := size + 1 
7T := [tt, size] 
Gen_Avoid(szze, x(l, &)) 
for i := 1 to k — 1 do 

7r := (size — i + 1, size — i) o 7r 
Gen_Avoid(size, x(i + 1, k)) 
end for 

for i := k — 1 to 1 by — 1 do 

tt := (size — i + 1, size — i) o 7r 
end for 
end if 
end procedure 



order among its successive recursive calls by endowing each permutation with a 
direction as described above; see also Figure [TJ 

4.1. Several well-known classes of regular patterns. Below we give several 
classes of regular patterns together with the x function. For each class, a recursive 
construction is given in the corresponding reference(s); it is based (often implicitly) 
on the distribution of active sites of the permutations belonging to the class. It is 
routine to express these recursive constructions in terms of \ functions and check 
the regularity of each class. 
Classes given by counting sequences: 



(i) 



2 n-l gj_ 

r={321,312},XT(*,fc) = 2 
Pell numbers [4]. 




(iii) 



even-index Fibonacci numbers [4]. 




(iv) 



Catalan numbers [T71 [5S] . 

- T = {312}, X T(i,k)=i + l 




(v) 



Schroder numbers [llj . 
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- T = {4231, 4132}, xt(i, fc) = 

- T = {4123, 4213}, Xr(i,k) = 
(vi) central binomial coefficients ( "Ti ) [H] 



k + 1 if i = 1 or i = k 

i + 1 otherwise 

fc + 1 if i = fc — 1 or i = fc 

i + 2 otherwise 



fc + 1 if i = 1 

T = {4321, 4231, 4312, 4132}, XT(i, fc) = { 3 if i = 2 



- T = {4231, 4132, 4213, 4123}, Xr(i, k) 
Variable length patterns: 



i otherwise 
3 if i = 1 
i + 1 otherwise 



fc + 1 if i = 1 and k < p 
(a) T = {321, (p+ 1)12... p}, xr(i,k)= { p ifi = landfc=p 



otherwise 



See for instance [314]. If p = 2, then we retrieve the case (i) above; p = 3 
corresponds to T = {321,4123} in case (iii); and p = oo corresponds to 
T = {321} in case (iv). 

!k + 1 if i = 1 and k < p 
p if i = 1 and k = p 
2 otherwise 

See for instance [4]. If p = 2, then we retrieve the case (i) above; if p = 3, 
the case (ii); and p = oo corresponds to T = {321, 3412} in case (iii). 
(c) T = U T&6p _ 1 {{p + l)rp}. 

fc + 1 if k<p or i>k — p+1 
i + p — 1 otherwise 
See [H [15j Q~6]. If f> = 2, then we retrieve the case T = {312} in point (iv) 
above; and p — 3 corresponds to T — {4123, 4213} in point (v). 
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